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ABSTRACT 

This paper presents the solution to the minimum transition time 
problem and the minimum fuel problem for a second order system with 
one zero. The control difficulties usually encountered due to dis- 
continuous action of the error states are eliminated by a transformation 
to a system with continuous variables. Optimum control of the trans- 
formed system is then accomplished using the methods of Pontryagin /1/. 
The control action is then related back to the original plant. 

Although the investigation is concerned entirely with a second order 
oscillatory system, the method is sufficiently general to be extended 
to the higher order system with Zeros. 

The writer would like to thank Associate Professor Harold A. Titus, 
U. S. Naval Postgraduate School, who suggested the problem and whose 
continued cooperation, encouragement and assistance made the results 


possible. 


li 











TABLE OF CONTENTS 


Section Title 
1. Introduction 
2. Pontryagin's Maximum Principle 
3. Development of System Equations 
4. The Minimum Time Problem 
9. The Minimum Fuel Problem 
6. Realization of Control 
7. Conclusions 
8. Appendix I 


Bibliography 


ait 


Page 


10 
24 
34 
37 
39 


43 








MeIMOCUC TION , 

When controlling the performance of a system, it is often desir- 
able to choose the control that will minimize errors in the system and 
do it in the shortest possible time. A practical matter that must be 
considered in the optimization in relation to rapid action is the fact 
that control is of a bounded nature. Ina great many important cases, 
the constraint on the magnitude of the control effort precludes the use 
of classical variational techniques to design the controller. 

In 1956 Pontryagin hypothesized his “maximum priciple" which 
has since been proven a necessary condition for the optimization of 
linear systems in relation to rapid action /1/. In solving the mini- 
mum time problem for linear systems with bounded control, the 
principle leads toa "bang-bang" form of control law. This implies 
that the control effort is always being applied at its maximum value. 
There remains, however, the task of finding the optimum time to 
switch the control. Pontryagin's method leads toa rule for switching 
the controller which is a function of the initial conditions in the 
system adjoint to the one being controlled. Generally these initial 
conditions are difficult to find. 

It is usually helpful to consider the control problem using state 
space techniques. The coordinates of the space for an Alaa order 


system here are a displacement error and its n-1 time derivatives. 








The space may be divided into two regions each of which is character- 
ized by the control optimal for the trajectories in that region. Optimum 
switching between the two conditions of the bang-bang control occur 
on the hypersurface dividing the space. The switching criteria can 
then be stated as a function of the state space variables. 

Of considerable value in finding the switching surface is the sys- 
tem adjoint to the system. The adjoint can be thought of as the system 
running in reverse time. By plotting trajectories from the origin of the 
error phase space "backwards" in time, with the control satisfying the 
respective adjoint variables, a surface is generated which may be re- 
lated to the optimal switching surface in the system state space. 

A problem of interest occurs when the system is of sucha nature 
that when control is applied, a discontinuity appears in one or more 
of the system states. This may happen when the control is of a bang- 
bang form and the forward transmission path of the system contains 
zeros. It could also show up if the control is of such a form that it 
approximates an impulse to the system. When there are discontinui- 
ties in the state space due to switching it is generally no longer 
possible to write the switching criteria as a function of the state 
space variables. 

One alternative might be to switch the control as a function of 


time. This may be done effectively when the number of switchings 





to reach the origin of the error state space is no more than n-1 inan 
ag order system. Sucha restriction limits one mainly to considering 
only those systems with real, distinct eigenvalues. Large disturbances 
in lightly damped (oscillatory) systems may require more than n-1 
switchings to zero the error states. The most important consideration 
when controlling as a function of time is the means of implementing 
the switching logic. To accomplish time dependent control, it is vir- 
tually mandatory that a digital computer be inserted in the control loop. 

Another approach to the problem is to find a system that reacts 
identically to the system with zeros except at the pointsof disconti- 
nuity. Control of this parallel system can be stated in terms of the 
state space variables. This logic can then be used to switch the 
original plant. 

This paper will be an investigation into the latter method. The 
problem is as follows: 

Given a second order oscillatory system with one zero, 

find the optimum control for zeroing the errors in the 

system in minimum time and for Zeroing the errors with 

minimum fuel. 

The method of Pontryagin is used to solve the problem. The brief 
description of the method presented here is based on the work of 


Rozonoer /1/. 





2. Pontryagin’'s maximum principle. 

Given the system state variables described by n first order 
differential equations 

x =f, (x,u, t) oa er yn (1) 

where xX is a column vector in phase space and u is a column con- 
trol vector consisting of r control elements. 

The control u(t) must belong toa closed subset U of admissi- 
ble controls and must be piecewise continuous. The trajectory x(t) 
in the phase space is uniquely determined by (1) when control u(t) 


and the initial conditions 


are given. 

The control u(t) of a system may be considered optimum under a 
variety of criteria. A large class of optimization problems may be 
solved by presenting the criteria in such a way that the solution is 
attained by minimizing a linear function of the final value of the state 
space variables. A control must be selected from U that will trans- 


fer the system (1) from x° to some fixed closed set G of the phase 








space such that 


n+ l 
S= > cx) (3) 
i i 
l 
is a minimum. The constants C, and the a hy coordinate are chosen 


such that minimizing (3) optimizes the system. 
In a great many cases optimization of only one of the coordinates 
of the system is desired. For example, in order to optimize the mag- 


nitude of 1 


J Pech) une) edit (4) 


for T and x(T) either fixed or free ina system (1) for u(t)eU, a 


new variable is introduced: 


Xae1 =f P(t), ult) at (S) 
a aes 


and another differential equation 


= F(x(t), u(t)) 


Tel 
is added to (1). The problem of optimizing the integral leads to 
optimizing x4 7) Sete ale 
Minimizing x47 1D) in the system (1) with x4 adjoined is 
accomplished by putting the problem in functional form (3) and apply- 


ing the maximum principle to gain the solution. That is 


n+] 


S=D ¢.x(T) =x .(f) (C) 
il DE 


n+ 1 





is the functional to be minimized. Here it may be seen that c, =c 


i 2 
meee O-andusc =]. 
n n+ 1 
A new dependent variable p(t) is now formed such that 
n+] of &. Wye) 
p, (t) par a) ad ical... n+l (7) 
The function 
n+] 
H=2 p_f_(x, u, t) (8) 
j ss 


is introduced from which equations (1) and (7) may now be written 


Salm Oued stipe nce Oe is 
*17 3p, bis 3x, | ae n+l (9) 





The control u*(t) is said to satisfy the maximum condition if 
H(x*(t) ,p*(t),u*(t)) reaches an absolute maximum at each time t 
(0 s t S T) where x* (t) and p*(t) are the values of the variables at 
time t with u*(t)€ U controlling. For linear systems of the type 


discussed in this paper, the necessary and sufficient condition for 
n+] 

minimizing S=2 cx, (T) optimally with admissible control is that 
] 

the control satisfy the maximum condition. 

To use the maximum principle, H is formed and maximized with 
respect to u(t). This produces a 
u*(t) = ¢ (x, p) (10) 


which may be used with equations (9) and the boundary conditions 


to find u*(x). If the end point of x(t) is not fixed, it becomes 
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necessary to obtain boundary conditions on p(t) in order to arrive at 
a solution. The conditions p(T) may be found using a function 
F(x) = 0 which describes G and _ (T) €G, the end point of an opti- 
mum trajectory. The form of p(T) will be stated without detailed 
explanation; however, it may be noticed that at time t=T, p(T) is 
n+ 1 1 
orthogonal to a hyperplane “ a (x, ~ x.) = 0 through the endpoint of 
the trajectory and directed toward that portion of G where 
n+] n+] 
: cx, s : CX, (T). The coefficients a, may be expressed as a 
linear combination of the Cc, and bd, (T)), the latter being coeffi-~ 
cients of a hyperplane through R (T) bracketing G. 
Thus 
p,(1) = -2c, wb, (7) (11) 

where A and p are non-negative numbers one of which may be set 
equal to unity as it is only the ratio that is important. 

Generally, three situations arise as to final boundary conditions. 

(i) If x, (T) are speciticdefomedl! = 15 2a (Sem then these 

become the boundary conditions for (9). 
(ii) If x; (T) are internal points of G for i(l si <ntl) 
then b a! (i). =O ania p(T) = -¢,. 
fia)? If x, (T) are boundary points of G for some i(1 S$ i<n+#l) 


then F(x(T)) = 0 and the p, (7) areas in (ll). 


When F is differentiable, the bracketing hyperplane through 








ete -—— *  — 
=... 
=-_— = = ee ee mee 





x! has coefficients 


tiny = A 
B & (T)) = 6x, x, = x, (T) (12) 


If finding the optimum control for minimum transit time another condi- 
tion must be fulfilled since T is not fixed beforehand. This condition 


is that H(T) = 0. 


3. Development of system equations. 


The equation of a second order system with zeros may be written 


G+ 20wée+ w*c=a_.l + aou (13) 


] 


where c is the output variable of the system and u is the output of 
a controller. 

This paper is concerned with control of similar systems that are 
purely oscillatory in nature i.e. © =0. To facilitate ease of com- 
putation in the analysis,equation (13) is scaled to 


c+c=a,uru (14) 


which when written in terms of the Laplace transform of the output 


variable becomes 

fa,s + 1)U(s) 
C(s) = 5 (15) 
s +] 


This system is represented in block diagram form in Fig. 1. 








CONTROL 





Fig. 1 - Block diagram of control system 


The response of the system toa step input is investigated more 
readily by means of the error variable 

a= -sc (16) 

If the input r is fed forward as in Fig. 2, the Laplace transform of 


the error, given 


Ct). = e> 
é(0) = é° 
R(s) = 4/s (17) 


becomes 


oe limes) Siete ok + aif) - (ais + 1)U(s) (18) 
Sy sl 


Now the problem of zeroing the error states reduces to that of zeroing 


the error initial conditions in the system. 


——E——— 4 pi =| —— 


ee 


®» E> =e ro -_ 





ei 


+ 
. (=) =} CONTROL (=) a age ? 
pe) 


Fig. 2 - Controlled system with input fed forward 
Finally with the introduction of state space variables 


e; = -e 


e2 = ey LS) 
the system equations can be written in vector matrix notation /3/ 


1 0 
ss e+ (20) 


-1 0} ayu tu 


4. The minimum time problem. 


The problem is stated as follows: 

Given the system (20) anda control force of bounded 
magnitude ju | < 1, find the optimum control u*(t) to 
transfer the state variables from some initial point in 
the phase space to the origin of the phase space in 


minimum time T. 


10 





That is, given 


Oo 


e(0) = 
e(T) = 


Jul < 


~~ Oj 


and the system (20), find u*(t) such that 
Ab 
S=)] adt 
) 


is a minimum where @ isa positive constant. 
Introduce 


T 
ey = @3 = s= | adt 


The system equations then become 


010 0 =| 
e =/-1 0 O} etia,urtu 
0 0 0 oO 


Because of (21), the functional 
S 
S=2D c,e,(T) = cse3(T) 
; if 


and since we wish to minimize this, c,z=1 is chosen. 


limited, hence the boundary condition becomes 
P3(T) = -cg = -1 
By (8), the hamiltonian becomes 


H = pyee2 — P2e1 + P2(azu+ u) + pPs& 


=e) Jel 
0 @3 





Since pz= 


fore ps = p3(T) =-l and now H is 


11 


(22) 


(23) 


(24) 


(25) 


e,(T) is not 


(26) 


(27) 


= 0 itis evident that ps is a constant and there- 








Hee bres Pacer + Palenu + uj o (28) 

which is maximized in u if 
al a —eNiognen. | (29) 
where N = max la, + u | for each fixed t(0 $ t S T). The control 
u*(t) which satisfies these conditions is a "bang-bang" type control 
where u=+1 atall times and wu at the moment of switching is 
unbounded. 
Since es has served its purpose in the optimization process, 

we may now return to the second order system and solve for the 


"impulse" variables. By (9), 


Ed : 


and the solution for u*(t) becomes 
u*(t) = 1° sgn[cos(t +@) ] (31) 
where @ isa phase angle dependent on x°®. 

Several properties of the optimum controller are now known. 
First, the control is a bang-bang type which applies maximum effort 
at all times in one of the two "directions". It is switched periodi- 
cally from one state to the other every half cycle until the origin is 
reached. Notice that each time the control is switched, a disconti- 
nuity appears in the ez variable. This occurs because u contains 


an impulse. 


MZ 


7 





+ + 


v Fe 


Qe2= J ter + a,u + u) dt= | arude =a) Cu(t_) = u(t.) J (32) 
where Aes is the discontinuity in es at the time of switching t.. 
One would now like to find a switching curve L(e) which 
divides the phase plane e, vS eg in sucha manner that control 
u* =+]1 is optimum in the space to one side of the curve and u* = -]l 
elsewhere. Control would be switched when the trajectory e* (t) 
crosses the curve. The discontinuity Oes precludes this possi- 
bility. For example, examine the trajectory e*(t) for some initial 
conditions that dictate u* = -1] for optimum control. At the point 
where this trajectory crosses L(e) the optimum becomes u* =+1. 
The control switches and Mezg =+2a, occurs which places the states 
back in the space where u* = -1l was optimum. Here the control 
switches again, Aes = -2a, occurs and chatter motion begins. The 
fact that es is multiple valued at the instant of switching makes a 
simple realization of L(e) impossible. 
For periods between switchings where u = 0, the system is well 
behaved with the solution for the ee interval 
e,(t) = Kcos (t+ ¢,) - 6 
(33) 
eo(t) = Kcos (t+ ¢, + 7/2) 
where § =1°*Sgn pe and K,¢, depend on conditions of states at 


ty 
the start of the k interval. 


13 





4.1 The transformed variable. 

The search for a variable of the system on which to control leads 
to the possibility of "subtracting out" the discontinuity present in 
€2 at times of switching. 

The Laplace transforms of the system variables are 


efs + e8 + (ais + 1) U(s) 


Ei(s) = Sigil 
(3 4) 
(os ©: 
Ee(s) = £25 cis s(ais + 1) U(s) 
s~ + ] 
where 
_ (2 gnts, 2 ontes_ 
tse 6 see + SOT teen eee ) (35) 
which for any instant of time t(0 <S t < t)) 
Wie) 86) 
S 
Equations (34) then become 
ae ae (oe a 
Ei (s) - Cr°s i ai6) S 6 
s(s* + 1) 
(37) 
8+ + (-ef + 
Ee (s) = (e2 ane) Shai ele es), 
s +] 
By means of the initial value theorem, it is seen that 
lim e, (t) = lim sE, (s) = ef 
te s7@ (38) 


lim e2(t) = lim sE2(s) = e8 + a, 6 
t~ 0 s7 a 


At time t= 0, es jumps to eg +a ,6. To remove this discontinuity 


14 





OO 


consider the transformed variables 


Yi(s) = E,(s) 


(39) 
Y2 (s) — Eo2(s - a6 
S 
By virtue of (39) and (20) 
SY7(s} ="SE;(s) = Ea(s) = Ye(s) + oo 
; (40) 


SY2(s) = sEe(s) - a,6 = -Y,(s) + = 


0 ] ai 
ad peer a 6) (41) 


where 6 isa unit step function with sign to be determined. The 


Or 


system (41) is identical to that of (20) except for the action at 
time of switching. It should be noted, however, that care must be 
taken in assigning final values to the system described by (41) if 
the two plants are to be controlled in parallel. The final value 


theorem and (39) gives 


ai6 





lim ye(t) = lim sYe2(s) = lim s(E2(s) - = -a6 (42) 


to Se U s70 
From this it is observed that zeroing the final states in (20) is 
analagous to zeroing y,(T) and attaining a final value 
Val) sano (43) 


in the system (41). 
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4.2 Boundary conditions and final control. 

From (38) and (39) it is clear that the initial conditions on 
the e and y variables are identical. From (39) it is also seen 
that 

vage= C1\ 1) 
(44) 
y3(T) = e2(T) - a,6(T) 
At this point in the pursuit of the optimum control, it becomes neces- 
sary to investigate the system action possible at time t= T under 
admissible control. Aes of (32) provides a means of changing the 
value of ee instantaneously by an amount dictated by the constraints 
on u(t). With this in mind, it is noted that appropriate use of Aes 
within the bounds of allowable control may zero the e€es variable in 
zero time given that e2(T) is within range. The conditions (21) 
and (44) with (32) indicate that for 
ly2(T)| $ ay (45) 
the system (20) may be zeroed ecu . The boundary conditions 


on (41) then become 


as Y, ier 2 
yi(T) = 0 (46) 
lye (T)| < ay 


ihe conditions are stated in terms of the y variable for con- 
venience in order that notational problems arising from multiple 
value of e2(0) be avoided. 


16 








The final controller us(T) that must zero the errors for t>T 
has two conditions imposed upon it i.e., 


ayUe + Us = 0 


(47) 
us(T) - 6(T) = eee) 
ay 
The solution to (47) is 
a(t) = 2 exp (=EE) tat (48) 


It is assumed then that ue(t) is available at time t=T so that the 


boundary conditions on the system are as stated in (46). 


4.3 Switching functions. 


The method of finding a function L(y) with which to describe 
the switching criteria for the optimum trajectory proceeds as follows. 


As in the discontinuous case, it is desired that 


T 
S = | a dt (49) 
0 
be minimized, therefore, another variable yz=S=csys3(T) is 
adjoined to the system and once again c, = ce = 0. The hamiltonian 
becomes 
H = piye + pyaid - P2yi + p2b - & (50) 
This is maximized in § when 
§ = 1+ sgn (a,pi + Pa) (51) 


With this control, trajectories are circular about (6, -a,6) with 


17 
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radius determined by y°. (See Fig. 3) 





——_ > _ direction of 
positive time 


Fig. 3 yiVS Ye phase plane with trajectories for §6=+1 
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Previous arguments have determined that the conditions on the 


system are 


7 ae {eS 

mn) PS e0 

lye(T)| $ ay | (52) 
H(T) = 0 

Se) al 


The function F = = (y3 - any) = Q may be used to describe G. 


From this 
OF 


= Ye (53) 
“ve Ye =Ye 


be(ya(T)) = 


and 
P2(T) = -Ace2 - wba lya(T)) = -py2 (54) 

where pw 2 0 with modulus such that F(T) = 0. In the phase plane 
of Pi VS Pe it is sufficient to note that for trajectories terminating 
at ye(T) = -a,, p2(T) 2 0 and for trajectories ending at yo(T) = +a}, 
P2(T) = 0. This information in addition to the control (51) com- 
pletely define L(y) for trajectories ending on the extremes of the 
line segment lye (T) | S aj. 

Fig. 4 depicts representative action for optimum trajectories 
terminating at ye(T) = -a,, yi(T) = 0. Trajectories ending at 


y2(T)=+a., yi(T) = 0 are mirror images. The optimum switching 


Lg 





curves are generated by picking arbitrary values of p(T) from the 
admissible set for the corresponding boundary values of y(t) and 
working backwards in time plotting the switching points determined 


from p(-t) onthe y, vS yg phase plane. 
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For trajectories ending in the interior of the line segment where 
lya(T) |< a; , ba(ye(T)) =0 and, therefore, pz2(T) =0. This com- 
pletes the information necessary to describe L(y). Fig. 5 shows a 
representative trajectory arrived at by translating switching criteria 
from the p - plane tothe y - plane. Fig. 6 portrays the curve with 


all dimensions. 





Q;Pi + pe = 0 





— — — switching curve 


Fig. 5 pi VS Pe and y, VS ye phase planes with complete switching 
curves 
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Fig. 6 - Optimum switching curve ( minimum time ) 
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Fig. 8 - Optimum trajectories of e(t) and y(t) (minimum time) 
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Fig. 9 - Optimum trajectories of e(t) and y(t) ( minimum time ) 
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9. The minimum fuel problem. 


The minimum fuel problem is solved by minimizing the integral 


ot A 
i=] (lu| + la,u |) dt (55) 
0 
in the system (20) where T is not specified. It appears simpler, 
however, to once again make use of the transformed variable y(t). 
By minimizing 
iE 
fg 
T=] fuldt (56) 
0 
in the transformed system (41), the desired result can be obtained 
provided 
i) the switchings in the time interval 0< t<T are 
kept to a minimum. 
ii) adjustment is made at time t= T when fuel is 
consumed zeroing the error states e(t) with the 
exponential control ug(T). 
After adjoining (56) to the system (41), the hamiltonian 
becomes; 
H = piye - Peyi + u(ayp; + pe) - |u| (57) 
Since T is not specified H(t) = 0. With u(t) constrained as 
before, the control that maximizes H with respect to p(t) is: 
u* = 1° sgn (a,pi + Pa) |aiPy 1 Pe | ze i 


(58) 
u* = 0 larp: + pe| <1 
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5.1 Initial Conditions. 


Taking the time derivative of H 


dH _ du d|u| 
a (aiP; + Pe) it dt (59) 
dH au 
it can be seen that ae rot Bros O. It may also be argued that 
the change in the hamiltonian with time is zero if 
d |u| yaN |u| 
+ = = 
€4iPi1 + Pe re i (60) 


Since u(t) is switching between u=0 and u=#1 and vice versa, 
this means that the hamiltonian remains constant if the control is 


switched at a,P; + Pe = 1° sgn (Au), (See Fig. 10). 
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By choosing control u*(t) the hamiltonian remains at its maxi- 
mum value i.e. identically zero from time t=0 after initial control 
has been applied until time t= T. This control minimizes the 
integral (56) but does not necessarily minimize total fuel when fuel 
consumed at switchings is added. In order to minimize switchings, 
it appears necessary to choose the degenerate case i.e. u= 0 
until such time as ap, + Pe = 1° sgn (4u) where Au is the change 
in u(t) when turning the control on. Notice that this choice 
guarantees that H(t)=0 forall t, 0St<T. With this in mind, 
the problem remains to minimize fuel in the non-degenerate case. 

For this purpose it will be considered that time t= 0 is that time 
when 

aiP1; + Pe = 1° sgn (Mu) (61) 
and initial control is applied. 

At t=0 it may be verified from (61) and because H (0) = 0 
that 


y3 - p32 xp = 0 (62) 


5.2 Final boundary conditions. 


In order to investigate final value boundary conditions, the 
optimum trajectories terminating such that y,(T-At)>0 are consi- 


dered. Trajectories in the rest of the space are mirror images. As 
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in the minimum time problem, an optimum trajectory terminating at 
y2(T) = -a,,y,(T) = 0 is investigated first. The determination that 
P2(T) 20 as argued in (54) is still valid. This condition on po2(T) 
along with the fact that H(T) = 0 precludes the possibility of a 
trajectory terminating as above with u(T) =-1l. The following cases 
however, doapply. Consider 

H(T) = -a,pi(T) + u(T) faypi(T) + p2(T)] - |u(T)| = 0 (63) 

This condition implies thatif u({T) = 0 then p,(i) = 0gand 
u(T) =+1 then p,(T) 20 and p2(T) =+1. Fig. 11 portrays the locus 


of admissible points p(T) and the switching curves generated by 


these criteria in the y,vSsye2 phase plane are as in Fig. lla. 
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Optimum trajectories terminating on the line segment y;,(T) = 
Ue | y2(T) |< a, must be investigated in a fashion similar to that 
used with the minimum time problem. Since a final boundary point 
y2(T) is not fixed, we may substitute a final condition on pze2(T) 
to reach a solution. At this point it becomes necessary to decide 
on the final value functional to be minimized. It is first noted 
that if the final control to the line segment is u(T) = 0, then 
-ai<ye2(T) <0. (It must be remembered that investigation is of 
trajectories such that y,(T-At)>0). If u(T) =0 then also y=2(T) = 
e2(T) and in order to minimize the fuel consumed by us(T) to zero 
eo after time T then leo (T) | = lye (T) | must be minimized. 

If the final control is u(T) =-1 (u(T) =+1 is not possible for 
trajectories terminating on this side of the line segment) then 
e2(T) = ye(T) - a, and, therefore, | y2(T) - a; | must be minimized. 
In both of the above cases, it may be seen that ye(T) must be 
maximized on the line segment in order that fuel consumed by 
u2(T) to zero the error states be minimized. Therefore, the functional 


to be minimized is 


3 
S=2 cy, (7) = -y2(T) + ys (T) (64) 
1 
where 
R: 
ya(t) = | luldt (65) 
‘@) 


By prior arguments p2(T) = -ce =+1 and p,(T) = pa(t) = -cg = -l. 
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9.3 Generating the switching curve segments. 


It is now helpful to look at the hamiltonian under each of the 


above conditions, i.e., u(T)=0O and u(T) =-1. In the first case 
ue = 0 
H(T) = H(t) =0 
yi(T) = 0 (66) 
Pe(T) = +1 


-ai<ye2(T) <0 
and 
H(T) = pi(T)ye(T) = 0 
which implies that p,(T) = 0. Fig. 12 shows the switching gener- 


ated by this condition. 
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Fig. 12 Switching criteria for u(T)=0 (minimum fuel) 
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Next is considered the case where 


ue] 
Hoy) = Ht) = 0 
(67) 
yi(T) = 0 
pa(T) = +1 
and 
H(T) = pi(T)y2(T) - 1lfaipi(T) + 1J- 1=0 
from which 
p(T) = —_ (68) 
y2(T) - a 
Since u(T) =-1 and p2(T) = +1, conditions (58) are met only when 


p(T) < = which implies y2(T) >0. In Fig. 13 these trajectories 


and switching curves are plotted. 
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Fig. 13 Admissible p(T) where u(T) = -1 
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5.4 The complete switching curve. 


Because T was never specified and because the fuel consumed 
at switching was handled as a side condition, a composite of all the 
calculated switching curves indicates areas in the phase plane where 
criteria for optimum control appear contradictory. In these areas, 
analysis by graphical means or actual computation will clear up the 
situation. Fig. 14 depicts the composite of the first two criteria 


analized. 
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Pig. 13a Switching criteria where u(T) = -1 
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In Fig. 14, region A is an area where there is a question con- 
cerning whether it is optimum to switch for lv2(T) | = a, -or 
lye (T) | <ai. By graphical analysis, it may be seen that it is opti- 
mum to switch so that ly2(T) | = 41. 

A similar contradiction between trajectories switching for 
0 <yo2(T) <a, and -a,;<ye2(T)< 0 may also be resolved graphically. * 
The final result consisting of switching criteria to zero the errors 


in the system (20) with minimum fuel is given by Fig. 15. 





Fig. 14 Region of conflicting optimum criteria 


*Appendix I presents computational analysis of the resolving 
process. 
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Fig. 15 Switching criteria for minimum fuel, a,=1.0 
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6. Realization of control. 
With L(y) providing the switching logic everywhere except 
where y,(T) =0 and lve (T)|<a, and with ue available for final 


action, the controller can now be built (theoretically). 


+ ] e 1 e 
/ Ss Ss 
| 





Ye2 
L(y) | Yu 


y2(T) 


Fig. 16 Block diagram of the controlled plant 
By subtracting a,6 from eg(t), the variable ys(t) is gener- 
ated for use in control logic (Fig.15). Attime t=T, Sw 2 


designates Ue as the control and errors are instantaneously zeroed. 
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The complexity of the logic necessary to implement the switch- 
ing criteria may lead one to desire a simpler, quasi-optimum control. 
Two such controls are pictured in Fig. 17 for minimum time problem. 
Although detailed investigation of these controls was not carried 
out, it is submitted that both controls are close to optimum especially 
for large initial disturbances in the error space. Both controls were 
designed with the thought that chatter motion would not be tolerated, 
switching function would be linear overa large range, and exponen= 
tial control was available at end point of trajectory. 

It is further suggested that the system might be controlled on 
the error states instead of the transformed variable if constraints are 
put on time intervals between switchings so that chatter motion is 


avoided. 
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7. Conclusions. 

The methods used in this paper to arrive ata solution may be 
used to good advantage in the investigation of any AD order 
system with no more than n-1 zeros. The maximum priciple pro- 
vides a powerful tool in optimization, particularly for linear systems. 
Often the method of Pontryagin will indicate areas of interest to 
investigate when searching for an optimum control even if the unique 
solution is not readily forthcoming. 

The problem of controlling a plant with zeros is analagous to 
controlling a plant without zeros using an impulse-step type 
controller. Results obtained in this paper can be adapted to formulate 
the logic of this type control. 

The realization of the true optimum switching logic ina practical 
system may in many cases not be worth the effort. Quasi-optimum 
control using simple switching functions that are for the most Part 
linear is a subject for further investigation. Settling time forthe sys- 
tem is relatively insensitive to limited variations from the optimum 
when trajectories are out beyond the first cusp of the switching 
curve. The two quasi-optimum controls suggested in this paper 
concentrate on avoiding chatter motion. It may be that a control 
using “controlled chatter motion" /2/ would be acceptable in parti- 


cular systems. This type would be particularly attractive for control 
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of trajectories in the area of the first cusp when linear control 


functions are desired. 
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Appendix I 
Graphical analysis of optimum criteria interface 
Given y° inregion B of Fig. 16 the problem is to find which 
of the two possible switching criteria is optimum, i.e., whether 
for trajectories such that y,(T - At)>0 it is optimum to switch for 


0 <y2(T) <a, or -a, < y2(T)< 0. 





Fig. 16 Region of conflicting switching criteria 
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Consider y® oncurve 1 of Fig. 16 a distance R from the 
origin. Does it take less fuel toapply u{0) =-1 and Zero the 
corresponding values of e or should the degenerate case be 
chosen until such time as curve 2 is reached (where yy = 0 and 
y2 =R) and then switch? The fuel consumed when switching from 


Gurpve 2 is 


a, when control is turned on 
T- 2 
1/2 for | luldt 
fe) 
a when control turned off at ys=0 


ly3 (T) | to zero corresponding é2 (T) 
which when totalled is equal to R+ 7/2. 
The fuel consumed when switching from curve 1 is 
ay when control is turned on 
T 
al for ( lu|dt 
0 
lay - yo(T) | to zero corresponding e=2(T) 
The time T which is the time for the y(t) to progress from y°® 
at curve 1 to the line segment may be portrayed by use of p(t) 


as in Fig. 17. 
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Fig. 17 Time Tas a function of ¢, and ¢2 inp plane 


Here it is remembered that 


and that 


which implies 


2 
1h TD 
Pa (T) Y2(T) - a, 
Pe (T) = +] 
(69) 
aipy + pS =-l1 
T=, + 2+ 1/2 
H(0) = pP?y3 - psy? = 0 
p? = yr 
es 70) 
ee: (70. 


The total fuel from 1] then is a, + ¢,+ ¢e+ 9/2 + aa - y2(T) | and 


4] 





the angles ¢,; and @¢2 may be related to points in the y,; vs ye 








Space, 
-1 py? 1 vi 
=tan - — =tan - 
Pa pg y3 
(71) 
=| P2(T) -1 4, - Ya(T) 
= tan = = tan ——————— 
e Pp; (T) 2 


The point at which equal fuel is consumed when switching on curve 
1 or curve 2 is that point where 
R* = 2a; - ya(T) + $1 + ge (72) 
For R>R* optimum switching is on curve 2 


Computation of an example in the case where a, = 1.0 revealed: 


Yr = -1,355 
y2 = 2.140 
yi(T) = 0.0 

ye(T) = 0.347 
Re = 22005 
Fuel = 4.104 
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